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BY EXPRESS MAIL NO. EL254067301US 
Attorney Docket No. SCNY-Q9095 

SONY-Q9095 Rev.B PATENT 

INFORMATION PROCESSING APPARATUS, METHOD AND 
COMPUTER PROGRAM FOR VIRTUAL REALITY AURA SETTING 

5 INVENTOR: Satoru Matsuda 

CROSS-REFERENCE TO RELATED APPLICATIONS 

10 The present application is related to five other applications commonly 

assigned and concurrently filed therewith: Application No. 09/ , 

(attorney docket no. SONY-Q9008); Application No. 09/ , (attorney 

docket no. SONY-Q9087); Application No. 09/ , (attorney docket no. 

SONY-Q9094); Application No. 09/ , (attorney docket no. SONY- 

15 Q9096); and Application No. 09/ , (attorney docket no. SONY- 

Q9097), all of which are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

20 In general, the present invention relates to an information processing 

apparatus, an information processing method and a presentation medium. 
More particularly, the present invention relates to an information processing 
apparatus, an information processing method and a presentation medium which 
allow information on an application object (abbreviated hereafter to an AO) in 

25 a 3-dimensional virtual space to be reported to an avatar. 
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In a 3-dimensional virtual space on the Internet, a plurality of objects are 
provided with information on a position and a "Dive" system is known as a 
system which allows the objects to share the information on position. Details 
of the "Dive" system are described in a reference entitled "DIVE - A Platform 

5 for Multi-user Virtual Environments" authored by C. Carlsson and O. Hagsand, 
18(6) Computers and Graphics, pages 633-669 (1993). 

In the "Dive" system, however, the information is shared among all 
objects existing in the world, so that as the number of objects rises, there is 
raised a problem of an increased number of messages (an increased amount of 

10 information) exchanged among the objects. 

In order to solve this problem, an area referred to as an aura is defined 
for each object. An aura is a spatial area perceivable by an object defined for 
each object in which the object is capable of sensing other objects. Since only 
objects placed in the same area share information, the amount of information 

15 shared by objects can be suppressed even if the number of objects existing in 
the world increases. Details of this aura technique are described in a reference 
entitled "Virtual Society: Extending the WWW to Support a Multi-user 
Interactive Shared 3D Environment" authored by Yasuaki Honda et al., 
Proceedings of VRML f 95, pages 109 to 116 (ACM Press 1995). 

20 Details of the aura concept are described in a reference entitled "A 

Spatial Model of Interaction in Large Virtual Environments" authored by S. 
Benford and L. Fahlen in September 1993, in proceedings of G. DeMichelis et 
al. (Eds.) presented to a Third European Conference on Computer Supported 
Cooperative Work, pages 109 to 124 (Kluwer Academic Publishers). 
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By the way, an AO (application object) also exists in a 3-dimensional 
virtual space. An AO is a program having a variety of additional functions in 
the 3-dimensional virtual space. The program is executed on an AO server. 

In the technique utilizing the aura as described above, however, when a 
5 certain object (including an avatar) wants to sense an AO, such as a clock 
tower which is far away from the object, there is raised a problem that the 
object is not capable of sensing the AO if the AO is located outside the aura of 
the object. 

10 SUMMARY OF THE INVENTION 

The present invention allows information of an AO in a 3-dimensional 
virtual space to be reported to an avatar. 

According to one aspect of the present invention, there is provided an 
15 information processing apparatus for management of information on objects 
placed in a 3-dimensional virtual space, the information processing apparatus 
including: a sensing-area setting means for setting a sensing area used for a 
sensing object to sense information on one or more sensed objects within the 
sensing area; and a transmission-area setting means for setting a transmission 
20 area used for a transmitting object to transmit information to one or more 
receiving objects within the transmission area. 

According to another aspect of the present invention, there is provided 
an information processing method for management of information on objects 
placed in a 3-dimensional virtual space, the information processing method 
25 including the steps of: setting a sensing area used for a sensing object to sense 
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information on one or more sensed objects within the sensing area; and setting 
a transmission area used for a transmitting object to transmit information to one 
or more receiving objects within the transmission area. 

According to a further aspect of the present invention, there is provided 
5 a computer-readable medium for presenting a program executable by a 

computer to operate an information processing apparatus for management of 
information on objects placed in a 3-dimensional virtual space, the program to 
carry out processing including the steps of: setting a sensing area used for a 
sensing object to sense information on one or more sensed objects within the 
10 sensing area; and setting a transmission area used for a transmitting object to 
transmit information to one or more receiving objects within the transmission 
area. 

According to the present invention, the transmission area may be set 
wider than the sensing area. This allows information on an object to be 
15 reported to another object located at a remote position with a higher degree of 
reliability. 

A better understanding of the features and advantages of the present 
invention will be obtained by reference to the following detailed description 
and accompanying drawings which set forth illustrative embodiments in which 
20 the principles of the invention are utilized. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a typical configuration of a system 
25 presenting a shared virtual space to which the present invention is applied; 
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Fig. 2 is a block diagram showing a typical configuration of a client PC 
employed in the system shown in Fig. 1; 

Fig. 3 is an explanatory diagram used for describing the operation of the 
system shown in Fig. 1 ; 
5 Fig. 4 is an explanatory diagram used for describing the operation of the 

system shown in Fig. 1; 

Fig. 5 is an explanatory diagram used for describing the operation of the 
system shown in Fig. 1 ; 

Fig. 6 is an explanatory diagram used for describing an aura; 
10 Fig. 7 is an explanatory diagram used for describing sensing of an object 

accompanying a movement of an avatar; 

Fig. 8 is an explanatory diagram used for describing mismatching in 
sensing of avatars; 

Figs. 9A-9B are explanatory diagrams used for describing a 
15 transmission aura and a reception aura of an AO; 

Fig. 10 is an explanatory diagram used for describing management 
information of objects held in a shared server employed in the system shown in 
Fig. 1; 

Fig. 1 1 shows a flowchart representing movement notification 
20 processing; 

Figs. 12A-12B show flowcharts representing departure detection 
processing carried out at a step SI of the flowchart shown in Fig. 11; and 

Figs. 13A-13B show flowcharts representing inclusion detection 
processing carried out at a step S3 of the flowchart shown in Fig. 11. 

25 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 1 is a block diagram showing a typical configuration of a system 
presenting a shared virtual space to which the present invention is applied. It 
5 should be noted that the system cited in this specification means an entity 
obtained as a result of logically putting a plurality of apparatuses in a set 
without regard to whether or not the apparatuses are physically accommodated 
in a box. 

As shown in Fig. 1, client PCs (personal computers) 1 to 3 are 

10 connected to the Internet 7 through IPs (Internet connection service providers) 
4 to 6 respectively. In each of the client PCs 1 to 3, a VRML browser and a 
WWW browser are installed and ready to be operated. 

The client PCs 1 to 3 each have two functions, namely, a 3D client 
function and a 2D client function. The function for a 3D client is used to notify 

15 a shared server 12 periodically or if necessary of data such as information on 
the location of the client PC, to receive information shared by other 3D objects 
from the shared server 12 supplied thereto, and to display the information. On 
the other hand, the function for a 2D client is executed to transmit a request for 
information to a WWW server 10 in accordance with an HTTP, to receive a 

20 response to the request from the WWW server 10 and to display mainly 

2-dimensional information. When a URL is included in information received 
from the shared server 12, the 3D-client issues a request for an access to the 
URL to the 2D-client. At this request, the 2D-client makes an access to the 
URL (in actuality to the WWW server 10) to download data such as the shape 

25 of an object and forward the data to the 3D-client. 
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A LAN (Local Area Network) 9 is connected to the Internet 7 through a 
router 8. Connected to the LAN 9 are the WWW server 10, a WLS (World 
Location Server) 11, the shared server 12, AO (Application Object) servers 13 
and 14, a mail server 15 and a communication server 16. The WWW server 10 
5 has hard discs (HDDs) 10a and 10b whereas the other servers 1 1 to 16 have 
HDDs 11a to 16a, respectively. 

It should be noted that the AO server 13 has a program for 
communicating with the shared server 12 to present for example an application 
object (AO) such as a robot or an electronic pet which moves autonomously in 
10 a virtual space. Much like the 3D-client function, the AO server 13 

communicates with the shared server 12 to report information on itself and to 
receive information shared by other 3D objects. 

The communication server 16 is connected to a telephone 18 or a 
facsimile 19 through a public telephone line network 17, and is radio-connected 
15 to a PHS (Personal Handyphone System) terminal 23 through a PHS service 
provider 20 and to a pocket-bell terminal 24 through a pager service provider 
21. 

Fig. 2 is a block diagram showing a typical configuration of hardware of 
the client PC 1. In this configuration, a CPU 30 carries out various kinds of 
20 processing by executing a program stored in a ROM 34. A HDD 31 is used for 
storing, among other information, VRML contents such as VRML2.0 files and 
predetermined script programs written in the Java (a trademark of Sun 
Microsystems, USA). A CD-ROM drive 32 reads out VRML contents stored 
in a CD-ROM disc 33. 
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Connected to a microphone 36 as well as right and left speakers 37 and 
38, a sound processing circuit 35 inputs a sound from the microphone 36 or 
outputs sounds such as music and sound effects to the speakers 37 and 38. A 
modem 39 (or other interface device) connected to the Internet 7 is used for 
5 exchanging data with the Internet 7. An I/O (input/output) interface 40 
receives operation signals from a mouse 41 and a keyboard 42. A graphics 
circuit 43 includes an embedded VRAM 44 for storing picture data completing 
various kinds of processing. The graphics circuit 43 reads out data from the 
VRAM 44, outputting the data to a CRT monitor 45. 

10 A WWW browser such as Netscape Navigator, a Java interpreter and the 

Community Place Browser are loaded into a RAM 46 to be executed by the 
CPU 30. Netscape Navigator is a WWW browser running under the Windows 
95 (a trademark of Microsoft Corp.) and the Community Place Browser is a 
VRML2.0 browser developed by Sony Corporation, the assignee of the present 

15 application. 

The VRML2.0 browser implements QvLib (which is a library [or a 
parser] for interpreting the VRML syntax developed and gratuitously released 
by Silicon Graphics, Inc.) and RenderWare (which is a software renderer 
developed by Criterion Software Ltd., UK) or a parser and a renderer having 

20 capabilities equivalent to those of QvLib and RenderWare respectively. 

As shown in Fig. 1, the Community Place Browser exchanges various 
kinds of data with the Netscape Navigator serving as a WWW browser in 
accordance with a NCAPI (Netscape Client Application Programming 
Interface, a trademark). 
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The Netscape Navigator browser receives an HTML file and VRML 
contents (including a VRML file and a script program written in the Java 
language) transmitted by the WWW server 10 by way of the Internet 7, storing 
the HTML file and the VRML contents in the local HDD 31. The Netscape 

5 Navigator browser processes the HTML file, displaying a text and a picture 
obtained as a result of the processing on a CRT monitor 45. On the other hand, 
the Community Place Browser processes the VRML file to display a 
3-dimensional virtual space on the CRT monitor 45 and changes behaviors of 
objects in the 3-dimensional virtual space and other display states in 

10 accordance with a result of execution of the script program by the Java 
interpreter. 

It should be noted that the other client PC 2 and PC 3 each have the 
same configuration as the client PC 1 even though the configurations of the PC 
2 and PC 3 are not shown explicitly in the figure. 

15 Next, the operation of the embodiment described above is explained by 

referring to Figs. 3 to 5. In the state shown in Fig. 3, first of all, a homepage on 
a web site providing VRML contents is browsed by using the WWW browser 
as shown by reference number Al . In this example, the homepage is accessed 
at <http://pc.sony.co.jp/sapari/>. Then, the user of the client PC 1 or PC 2 

20 downloads VRML contents including a VRML2.0 file and a script program 
written in the Java language to enable autonomous motions in a VRML space 
as shown by reference number A2. 

It is needless to say that VRML contents can also be obtained by letting 
the CD-ROM drive 32 read out the contents from the CD-ROM disc 33. 
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Then, the Community Place Browser serving as a VRML2.0 browser in 
the client PC 1 or PC 2 interprets and executes the VRML2.0 file downloaded 
and temporarily stored in the local HDD 31 as shown in Fig. 4 and, as indicated 
by reference number A3, an inquiry about the URL of the shared server 12 is 

5 transmitted to the WLS 1 1 in accordance with a VSCP (Virtual Society Server 
Client Protocol). Upon receiving the inquiry, the WLS 1 1 searches a shared 
server URL management table stored in the HDD 1 la for the URL inquired 
and transmits the URL of the shared sever 12 to the client PC 1 or 2 in response 
to the inquiry as indicated by reference number A4. 

10 The URL thus found is used to connect the client PC 1 and 2 to the 

shared server 12 as shown in Fig. 5. As a result, a shared message on attributes 
of a shared 3D object such as the position and the motion thereof is transmitted 
by way of the shared server 12 as indicated by reference number A5 and the 
shared message is forwarded to other client PC as indicated by reference 

15 number A6. In this way, a multi-user environment is implemented. 

For a detailed description of the above connection procedure, refer to 
U.S. Patent Application No. 08/678,340. 

While the 3-dimensional virtual space is used under a multi-user 
environment in this case, the 3-dimensional virtual space may be used under an 

20 environment other than a multi-user environment as well. That is to say, the 
3-dimensional virtual space may be used under an environment which is 
referred to hereafter as a single-user environment for the sake of convenience. 
In a single-user environment, the avatar of another user is not allowed to appear 
in the 3-dimensional virtual space and the avatar of the user herself/himself is 

25 not allowed to appear in the 3-dimensional virtual space of the client PC of a 
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user other than this particular user initiating the pieces of processing indicated 
by reference numbers Al and A2. For the sake of convenience, the avatar of 
another user and the avatar of the particular user are referred to as a drawn 
avatar and a pilot avatar respectively. In order to establish a single-user 

5 environment, it is not necessary to carry out the pieces of processing indicated 
by reference numbers A3 to A6. 

Next, an aura is explained by referring to Fig. 6. As shown in the figure, 
an aura 52 with a spherical shape having a predetermined radius is formed 
around a pilot avatar 51 with the center of the sphere coinciding with pilot 

10 avatar 5 1 . The pilot avatar 5 1 is capable of receiving information from another 
object located inside the aura 52. That is to say, the pilot avatar 51 is capable 
of visually recognizing a drawn avatar 53-1 and an application object (AO) 
54-1 which are located inside the aura 52. To put it concretely, the pictures of 
the drawn avatar 53-1 and the object 54-1 are displayed on the CRT monitor of 

1 5 the client PC of the pilot avatar 5 1 . However, the pilot avatar 5 1 is capable of 
visually recognizing neither a drawn avatar 53-2 nor an application object (AO) 
54-2 which are located outside the aura 52. To put it concretely, the pictures 
of the drawn avatar 53-2 and the object 54-2 are not displayed on the CRT 
monitor of the client PC of the pilot avatar 51. 

20 By the same token, an aura is also set for each of the other objects, 

namely, the drawn avatar 53-1 and the object 54-1, the drawn avatar 53-2 and 
the object 54-2. In this system, the size of each aura is uniform for all client 
PCs. It should be noted, however, that the aura of an AO can be set with a size 
different from the aura of the avatar if necessary. Furthermore, the use of a 
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spherical aura is merely for convenience and an irregularly- shaped aura may be 
used if so desired. 

With the aura 52 prescribed as described above, it becomes necessary 
for the pilot avatar 51 to acquire information from the drawn avatar 53-1 and 
5 the object 54-1 but not from the drawn avatar 53-2 and the object 54-2 which 
are located outside the aura 52. The amount of information to be received can 
thus be reduced. 

Consider an example shown in Fig. 7. When the avatar 51 moves, 
information on its new position is transmitted to the shared server 12. Upon 

10 receiving the information on the new position of the avatar 51, the shared 

server 12 identifies what objects (including avatars) are located inside the aura 
52 centered at the new position of the avatar 51 and transmits information on 
the objects to the client PC of the avatar 51. In the example shown in Fig. 7, 
since an object 54-1 is identified as an object located inside the aura 52 

15 centered at the new position of the avatar 51 after its movement, the shared 

server 12 transmits information on the object 54-1 to the client PC of the avatar 
51. Upon receiving the information on the object 54-1, the client PC of the 
avatar 51 displays the picture of the object 54-1, allowing the user of the avatar 
51 to visually recognize the object 54-1. 

20 If a large number of objects exist in the world (the virtual space), there 

may also be many objects located inside the aura 52, increasing the amount of 
information to be received. In order to prevent the amount of information to be 
received from exceeding what is really required, a maximum number of objects 
in an aura that can be visually recognized by the avatar of the aura is set in 

25 advance to be controlled by the shared server 12. As a result, only information 
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on a number of objects not exceeding the selected maximum is transmitted. 
For example, assume that the maximum number of objects in the aura 52 that 
can be visually recognized by the avatar 51 is set at two and there are three or 
more objects located inside the aura 52. In this case, only two objects that are 
5 included first or at earliest times are taken into account. That is to say, 

information on the third and subsequent objects entered the aura 52 after the 
second one are not reported to the avatar 51 . The maximum number of objects 
in the aura 52 that can be visually recognized by the avatar 51 is set in advance 
at a value predetermined by, among other limiting factors, a restriction on 

10 resources in the client PC for the avatar 51 and a limit on a transmission 
bandwidth of a network between the client PC and the shared server 12. 

It should be noted, however, that the maximum number of objects in the 
aura 52 that can be visually recognized by the avatar 51 may exclude AOs 
(application objects) moving autonomously in the world. Thus, the avatar 51 is 

15 always capable of visually recognizing such an AO, even if the number of 
objects included in the aura 52 has already reached the maximum. 

By the way, if a maximum limit value is imposed on the number of 
objects in an aura that can be visually recognized by the avatar of the aura as 
described above, it will be quite within the bounds of possibility that 

20 imposition of such a limit results in a state of mismatching, that is a state in 
which the avatar of the aura is not capable of visually recognizing another 
avatar in spite of the fact that the other avatar is capable of visually recognizing 
the avatar of the aura. 

The state of mismatching cited above is exemplified by the following 

25 case. Assume that an avatar 51 enters an aura 62 of an avatar 61 after avatars 
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63 and 64 have already been included in the aura 62 as shown in Fig. 8. In this 
case, the avatar 51 visually recognizes the avatar 61 due to the fact that the 
avatar 61 is the only avatar in an aura 52 of the avatar 51. On the other hand, 
the avatar 61 is not capable of visually recognizing the avatar 51 due to the fact 

5 that, when the avatar 51 enters the aura 62, the maximum number of avatars 
that can be recognized by the avatar 61 in the aura 62 has been reached by the 
existence of the two other avatars 63 and 64 in the aura 62. Thus, when the 
third avatar 51 newly enters the aura 62, the avatar count exceeds the maximum 
number 2, making the avatar 61 incapable of visually recognizing the third 

10 avatar 51 . As a result, the avatar 61 is not capable of visually recognizing the 
other avatar 51, in spite of the fact that the other avatar 51 is capable of visually 
recognizing the avatar 61. Thus, for example, the avatar 51 is capable of 
requesting the avatar 61 to have a chat with the avatar 61, but the avatar 61 is 
not capable of accepting the request for the chat made by the avatar 51. 

15 In order to avoid such a state of mismatching, the system is designed, so 

that, if the avatar 51 is capable of visually recognizing the avatar 61, the avatar 
61 is also made capable of visually recognizing the newly entering avatar 51, 
even in a state in which the presence of the avatar 51 causes the avatar count in 
the aura 62 to exceed the maximum value thereof. It is thus possible to avoid a 

20 state of mismatching in which a specific avatar in an aura is not capable of 

visually recognizing another avatar in the aura in spite of the fact that the other 
avatar is capable of visually recognizing the specific avatar. 

So far, a reception aura of an avatar has been mainly explained. Next, a 
transmission aura of an AO provided by the present invention is described by 

25 referring to Fig. 9A. In this system, while only a reception aura is set for an 
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avatar, reception and transmission auras are set for an AO. As shown in Fig. 
9A, a reception aura 83 and a transmission aura 84 having a radius larger than 
that of the reception aura 83 are set for an AO 81 . The transmission aura 84 is 
capable of informing an avatar existing at a farther location of information on 

5 the AO 8 1 . (Note that transmission may also occur within the reception aura 
83.) A reception aura 85 of an avatar 82 has a radius equal to the reception 
aura 83. If desired, the reception aura 85 may have a radius different from that 
of the reception aura 83. Without setting the transmission aura 84, that is, with 
only the reception aura 83 set for the AO 81, the avatar 82 will not be capable 

10 of sensing the AO 81, which is a clock tower in this example, since the AO 81 
is located outside the reception aura 85 of the avatar 82. By setting also the 
transmission aura 84 having a radius greater than that of the reception aura 83, 
however, it is more positively within the bounds of possibility that the avatar 
82 is located inside the transmission aura 84, even if the avatar 82 is far away 

15 from the AO 81, so that the avatar 82 is capable of sensing the AO 81. 

Fig. 9B shows details similar to that of Fig. 9A, with the reception aura 
83b wider than the transmission aura 84b. Such a configuration is useful when 
the AO 81b is desired to receive information from the avatar 82 from a greater 
distance than the AO 81b is desired to transmit information. As an example, 

20 the AO 81b may be a VR police station that is able to receive information from 
avatars at a wide distance throughout the VR world. 

Fig. 1 1 shows a flowchart representing movement notification 
processing which is carried out by the shared server 12 when the shared server 
12 is informed of a movement of the avatar 82 in the virtual space shown in 

25 Fig. 9A. (Similar steps are undertaken with regard to the virtual space shown 
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in Fig. 9B.) It should be noted that the shared server 12 has information listed 
in a table shown in Fig. 10 for each object Z, namely a shared object 
management table. In the shared object management table shown in Fig. 10, a 
list (set) A is a set of other objects aware of the object Z. A list (set) B is a set 
5 of other objects known by the object Z. A transmission-aura validity flag 
indicates whether the transmission aura of the object Z is valid or invalid. 

As shown in Fig. 1 1, the flowchart begins with a step SI in which the 
shared server 12 carries out departure detection processing when the avatar 82 
moves. In the processing, the shared server 12 forms a judgment as to whether 

10 or not another object such as the AO 81 is no longer sensed by the avatar 82, 
that is, whether or not the other object is no longer included in the reception 
aura 85 of the avatar 82 due to the movement of the avatar 82. In the 
processing, the shared server 12 also forms a judgment as to whether or not the 
movement of the avatar 82 causes the avatar 82 to depart from the auras of 

15 other objects including the AO 81 . 

The flow of the processing then goes on to a step S2 in which the shared 
server 12 transmits a message on the movement of the avatar 82 to other 
objects in the world. This message may include information on the AO 81 to 
other VR objects within the transmission aura 84. The message may also 

20 include information to the avatar 82 on other VR objects within the reception 
aura 85. 

The flow of the processing then goes on to a step S3 in which the shared 
server 12 carries out inclusion detection processing. In the processing, the 
shared server 12 forms a judgment as to whether or not another object gets 
25 newly included in the reception aura 85 of the avatar 82 due to the movement 
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of the avatar 82. In the processing, the shared server 12 also forms a judgment 
as to whether or not the avatar 82 enters the auras of other objects such as the 
AO 81 due to the movement of the avatar 82. 

The formation of the judgment at the step SI is explained by referring to 
5 flowcharts shown in Figs. 12A-12B as follows. 

As shown in Fig. 12A, the flowchart begins with a step SI 1 in which the 
shared server 12 selects an object from those in the set B of the avatar 82 as an 
object X. 

The flow of the processing then goes on to a step S12 in which the 

10 shared server 12 forms a judgment as to whether or not all objects in the set B 
of the avatar 82 have completed the subsequent processing following step SI 2. 
If the outcome of the judgment formed at the step S12 indicates that all objects 
in the set B of the avatar 82 have not yet completed the subsequent processing, 
the flow of the processing goes on to a step SI 3. 

15 At the step S 1 3, the shared server 1 2 forms a judgment as to whether the 

transmission-aura area of the object X is valid or invalid. If the outcome of the 
judgment formed at the step S13 indicates that the transmission-aura area of the 
object X is invalid, the flow of the processing goes on to a step S14. 

At the step S14, the shared server 12 forms a judgment as to whether or 

20 not the object X is still included in the reception-aura area of the avatar 82 after 
the movement of the avatar 82. If the outcome of the judgment formed at the 
step S14 indicates that the object X is no longer included in the reception-aura 
area of the avatar 82, the flow of the processing goes on to a step S15. 

At the step S15, the shared server 12 deletes the object X from the set B 

25 of the avatar 82 and deletes the avatar 82 from the set A of the object X since 
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the object X is no longer in the reception-aura area of the avatar 82. That is to 
say, the shared sever 12 updates the shared object management tables (see Fig. 
10) of the avatar 82 and the object X. After the shared object management 
tables have been updated at the step S15, the flow of the processing goes back 

5 to the step SI 1 to repeat the processing described so far. 

It should be noted that, if the outcome of the judgment formed at the 
step S14 indicates that the object X is still included in the reception-aura area 
of the avatar 82, on the other hand, it is not necessary to delete the object X 
from the set B of the avatar 82 nor the avatar 82 from the set A of the object X. 

10 In this case, the flow of the processing goes back to the step SI 1, skipping the 
processing of the step S15. 

If the outcome of the judgment formed at the step S13 indicates that the 
transmission-aura area of the object X is valid, on the other hand, the flow of 
the processing goes on to a step S16. At the step SI 6, the shared server 12 

15 forms a judgment as to whether or not the avatar 82 is still included in the 

transmission-aura area of the object X after the movement of the avatar 82. If 
the outcome of the judgment formed at the step S16 indicates that the avatar 82 
is no longer included in the transmission-aura area of the object X, the flow of 
the processing goes on to the step S15 in which the shared sever 12 updates the 

20 shared object management tables as described above. After the shared object 
management tables have been updated at the step S 15, the flow of the 
processing goes back to the step Sll to repeat the processing described so far. 
It should be noted that, if the outcome of the judgment formed at the step S16 
indicates that the avatar 82 is still included in the transmission-aura area of the 

25 object X, on the other hand, it is not necessary to update the shared object 
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management tables. In this case, the flow of the processing goes back to the 
step SI 1, skipping the processing of the step S15. 

Thereafter, the pieces of processing of the steps SI 1 to SI 6 are carried 
out repeatedly as long as the outcome of the judgment formed at the step S12 

5 indicates that all the objects in the set B of the avatar 82 have not yet been 

selected. When all objects in the set B of the avatar 82 have been selected, the 
flow of the processing goes on to a step S17. At the step S17, the shared server 
12 selects an object from those in the set A of the avatar 82 as an object X. The 
flow of the processing then goes on to a step SI 8. 

10 At the step SI 8, the shared server 12 forms a judgment as to whether or 

not all objects in the set A of the avatar 82 have completed the processing steps 
following step SI 8. If the outcome of the judgment formed at the step S18 
indicates that all objects in the set A of the avatar 82 have not yet completed 
the subsequent processing, the flow of the processing goes on to a step SI 9. 

15 At the step S19, the shared server 12 forms a judgment as to whether the 

transmission-aura area of the avatar 82 is valid or invalid. If the outcome of the 
judgment formed at the step S19 indicates that the transmission-aura area of the 
object X is invalid, the flow of the processing goes on to a step S20. 

At the step S20, the shared server 12 forms a judgment as to whether or 

20 not the avatar 82 is still included in the reception-aura area of the object X after 
the movement of the avatar 82. If the outcome of the judgment formed at the 
step S20 indicates that the avatar 82 is no longer included in the reception-aura 
area of the object X, the flow of the processing goes on to a step S21. 

At the step S21, the shared server 12 deletes the avatar 82 from the set B 

25 of the object X and deletes the object X from the set A of the avatar 82 since 
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the avatar 82 is no longer in the reception- aura area of the object X. That is to 
say, the shared sever 12 updates the shared object management tables (see Fig. 
10) for the object X and the avatar 82. After the shared object management 
tables have been updated at the step S21, the flow of the processing goes back 
5 to the step S17 to repeat the processing described so far. 

It should be noted that, if the outcome of the judgment formed at the 
step S20 indicates that the avatar 82 is still included in the reception-aura area 
of the object X, on the other hand, it is not necessary to delete the avatar 82 
from the set B of the object X and delete the object X from the set A of the 

10 avatar 82. In this case, the flow of the processing goes back to the step S17, 
skipping the processing of the step S2L 

If the outcome of the judgment formed at the step S19 indicates that the 
transmission-aura area of the avatar 82 is valid, on the other hand, the flow of 
the processing goes on to a step S22. At the step S22, the shared server 12 

15 forms a judgment as to whether or not the object X is still included in the 

transmission-aura area of the avatar 82 after the movement of the avatar 82. If 
the outcome of the judgment formed at the step S22 indicates that the object X 
is not included in the transmission-aura area of the avatar 82 anymore, the flow 
of the processing goes on to the step S21 in which the shared sever 12 updates 

20 the shared object management tables as described above. After the shared 
object management tables have been updated at the step S21, the flow of the 
processing goes back to the step S17 to repeat the processing described so far. 
It should be noted that, if the outcome of the judgment formed at the step S22 
indicates that the object X is still included in the transmission-aura area of the 

25 avatar 82, on the other hand, it is not necessary to update the shared object 



-20- 



09/03/99 



SONY-Q9095 Rev.B PATENT 

management tables. In this case, the flow of the processing goes back to the 
step S17, skipping the processing of the step S2L 

Thereafter, the pieces of processing of the steps S17 to S22 are carried 
out repeatedly as long as the outcome of the judgment formed at the step S18 

5 indicates that objects in the set A of the avatar 82 have not yet all completed 
the subsequent processing. When all objects in the set A of the avatar 82 have 
completed the subsequent processing, the flow of departure detection 
processing is terminated and the flow of processing goes back to the step S2 of 
the flowchart shown in Fig. 1 1 . 

10 Next, the inclusion detection processing is explained by referring to 

flowcharts shown in Figs. 13A-13B as follows. 

As shown in Fig. 13A, the flowchart begins with a step S31 in which the 
shared server 12 selects an object from those in the shared object management 
table as an object X. The flow of the processing then goes on to a step S32. 

15 At the step S32, the shared server 12 forms a judgment as to whether or 

not all objects in the shared object management table have completed the 
subsequent processing. If all objects in the shared object management table 
have not yet completed the subsequent processing, the flow of the processing 
then goes on to a step S33. 

20 At the step S33, the shared server 12 forms a judgment as to whether or 

not the object X is the avatar 82 itself. If the object X is the avatar 82 itself, the 
flow of the processing goes back to the step S31. If the object X is not the 
avatar 82 itself, on the other hand, the flow of the processing goes on to a step 
S34. 
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At the step S34, the shared server 12 forms a judgment as to whether the 
transmission-aura area of the object X is valid or invalid. If the outcome of the 
judgment formed at the step S34 indicates that the transmission-aura area of the 
object X is invalid, the flow of the processing goes on to a step S35. 
5 At the step S35, the shared server 12 finds out if information in the 

shared object management table indicates that the avatar 82 is not aware of the 
object X and forms a judgment as to whether or not the object X is actually 
located in the reception-aura area of the avatar 82 after the movement of the 
avatar 82. If the information in the shared object management table shows that 
10 the avatar 82 is not aware of the object X but the outcome of the judgment 
formed at the step S35 indicates that the object X was included in the 
reception-aura area of the avatar 82 after the movement of the avatar 82, the 
flow of the processing goes on to a step S37. 

At the step S37, the shared server 12 adds the object X to the set B of 
15 the avatar 82 and adds the avatar 82 to the set A of the object X in the shared 
object management tables since the object X is now included in the 
reception-aura area of the avatar 82 due to the movement of the avatar 82. The 
flow of the processing then goes on to a step S38. 

If the information in the shared object management table shows that the 
20 avatar 82 is aware of the object X or the outcome of the judgment formed at the 
step S35 indicates that the object X is not included in the reception-aura area of 
the avatar 82 after the movement of the avatar 82, on the other hand, the flow 
of the processing goes on to the step S38, skipping the processing of the step 
S37 since updating is not required. The flow of the processing from the step 
25 S35 to the step S38 skipping the step S37 may represent a case in which the 
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object X has been excluded from the reception-aura area of the avatar 82 due to 
the movement of the avatar 82. 

If the outcome of the judgment formed at the step S34 indicates that the 
transmission-aura area of the object X is valid, on the other hand, the flow of 

5 the processing goes on to a step S36. 

At the step S36, the shared server 12 finds out if information in the 
shared object management table indicates that the avatar 82 is not aware of the 
object X and forms a judgment as to whether or not the avatar 82 has entered 
the transmission-aura area of the object X after the movement of the avatar 82. 

10 If the information in the shared object management table shows that the avatar 
82 is not aware of the object X, but the outcome of the judgment formed at the 
step S35 indicates that the avatar 82 has entered the transmission-aura area of 
the object X after the movement of the avatar 82, the flow of the processing 
goes on to the step S37 to update the shared object management table as 

15 described above. If the information in the shared object management table 
shows that the avatar 82 is aware of the object X or the outcome of the 
judgment formed at the step S36 indicates that the avatar 82 is not in the 
transmission-aura area of the object X after the movement of the avatar 82, on 
the other hand, the flow of the processing goes on to the step S38, skipping the 

20 processing of the step S37 since updating is not required. The flow of the 
processing from the step S36 to the step S38 skipping the step S37 may 
represent a case in which the avatar 82 has departed from the transmission-aura 
area of the object X due to the movement of the avatar 82. 

At the step S3 8, the shared server 12 forms a judgment as to whether the 

25 transmission-aura area of the avatar 82 is valid or invalid. If the outcome of the 
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judgment formed at the step S38 indicates that the transmission-aura area of the 
avatar 82 is invalid, the flow of the processing goes on to a step S39. 

At the step S39, the shared server 12 finds out if information in the 
shared object management table indicates that the object X is not aware of the 
5 avatar 82 and forms a judgment as to whether or not the avatar 82 has actually 
entered the reception-aura area of the object X after the movement of the object 
X. If the information in the shared object management table shows that the 
object X is not aware of the avatar 82 but the outcome of the judgment formed 
at the step S35 indicates that the avatar 82 has entered the reception-aura area 
10 of the object X after the movement of the object X, the flow of the processing 
goes on to a step S41. 

At the step S41, the shared server 12 adds the avatar 82 to the set B of 
the object X and adds the object X to the set A of the avatar 82 in the shared 
object management tables since the avatar 82 is now included in the 
15 reception-aura area of the object X due to the movement of the avatar 82. The 
flow of the processing then goes back to the step S3 1 . 

If the information in the shared object management table shows that the 
object X is aware of the avatar 82 or the outcome of the judgment formed at the 
step S39 indicates that the avatar 82 is not included in the reception-aura area 
20 of the object X after the movement of the avatar 82, on the other hand, the flow 
of the processing goes back to the step S31, skipping the processing of the step 
S41 since updating is not required. The flow of the processing from the step 
S39 back to the step S31 skipping the step S41 may represent a case in which 
the avatar 82 has departed from the reception-aura area of the object X due to 
25 the movement of the avatar 82. 
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If the outcome of the judgment formed at the step S38 indicates that the 
transmission-aura area of the avatar 82 is valid, on the other hand, the flow of 
the processing goes on to a step S40. 

At the step S40, the shared server 12 finds out if information in the 
5 shared object management table indicates that the object X is not aware of the 
avatar 82 and forms a judgment as to whether or not the object X is actually 
located in the transmission-aura area of the avatar 82 after the movement of the 
avatar 82. If the information in the shared object management table shows that 
the object X is not aware of the avatar 82 but the outcome of the judgment 
10 formed at the step S40 indicates that the object X has entered the 

transmission-aura area of the avatar 82 after the movement of the avatar 82, the 
flow of the processing goes on to the step S41 to update the shared object 
management table as described above. If the information in the shared object 
management table shows that the object X is aware of the avatar 82 or the 
15 outcome of the judgment formed at the step S40 indicates that the object X is 
not in the transmission-aura area of the avatar 82 after the movement of the 
avatar 82, on the other hand, the flow of the processing goes back to the step 
S31, skipping the processing of the step S41 since updating is not required. 
The flow of the processing from the step S40 back to the step S31 skipping the 
20 step S41 may represent a case in which the object X has been excluded from 
the transmission-aura area of the avatar 82 due to the movement of the avatar 
82. 

The pieces of processing in the steps S31 to S41 are carried out 
repeatedly as long as the outcome of the judgment formed at the step S32 
25 indicates that all the objects in the shared object management table have not yet 
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completed the subsequent processing. When all objects in the shared object 
management table have completed the subsequent processing, the flow of the 
processing is terminated and goes back to the calling program. 

It should be noted that a computer program to be executed for carrying 

5 out the various kinds of processing described above may be presented to the 
user in computer-readable form through presentation media which can be 
network presentation media such as a network, or information recording media 
such as a CD-R, a CD-ROM or a floppy disc. As an alternative, the program 
can be stored in an embedded RAM or a hard disc if necessary. 

10 It should be understood that various alternatives to the embodiments of 

the invention described herein may be employed in practicing the invention. It 
is intended that the following claims define the scope of the invention and that 
structures within the scope of these claims and their equivalents are covered 
thereby. 
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1 . An information processing apparatus for management of 
information on objects placed in a 3-dimensional virtual space, said 

5 information processing apparatus comprising: 

a sensing-area setting means for setting a sensing area used for a sensing 
object to sense information on one or more sensed objects within said sensing 
area; and 

a transmission-area setting means for setting a transmission area used 
10 for a transmitting object to transmit information to one or more receiving 
objects within said transmission area. 

2. The information processing apparatus of claim 1, wherein said 
transmission area is wider than said sensing area. 

15 

3. The information processing apparatus of claim 1, wherein said 
sensing area is wider than said transmission area. 

4. The information processing apparatus of claim 1, wherein said 
20 transmitting object is said sensing object. 
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5. The information processing apparatus of claim 1, further 
comprising: 

interaction means for exchanging data between said sensing object and 
said one or more sensed objects based on said sensing area, and between said 
5 transmitting object and said one or more receiving objects based on said 
transmission area. 

6. The information processing apparatus of claim 1, further 
comprising: 

10 determination means for determining whether said one or more sensed 

objects are within said sensing area, and for determining whether said one or 
more receiving objects are within said transmission area. 

7. An information processing method for management of 
15 information on objects placed in a 3-dimensional virtual space, said 

information processing method comprising the steps of: 

setting a sensing area used for a sensing object to sense information on 
one or more sensed objects within said sensing area; and 

setting a transmission area used for a transmitting object to transmit 
20 information to one or more receiving objects within said transmission area. 

8. The information processing method of claim 7, wherein said 
transmission area is wider than said sensing area. 
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9. The information processing method of claim 7, wherein said 
sensing area is wider than said transmission area. 



10. The information processing method of claim 7, wherein said 
5 transmitting object is said sensing object. 

1 1 . The information processing method of claim 7, further 
comprising the step of: 

exchanging data between said sensing object and said one or more 
10 sensed objects based on said sensing area, and between said transmitting object 
and said one or more receiving objects based on said transmission area. 

12. The information processing method of claim 7, further 
comprising the step of: 

15 determining whether said one or more sensed objects are within said 

sensing area, and whether said one or more receiving objects are within said 
transmission area. 
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13. A computer-readable medium for presenting a program 
executable by a computer to operate an information processing apparatus for 
management of information on objects placed in a 3 -dimensional virtual space, 
said program to carry out processing including the steps of: 
5 setting a sensing area used for a sensing object to sense information on 

one or more sensed objects within said sensing area; and 

setting a transmission area used for a transmitting object to transmit 
information to one or more receiving objects within said transmission area. 

10 14. The computer-readable medium of claim 13, wherein said 

transmission area is wider than said sensing area. 

15. The computer-readable medium of claim 13, wherein said 
sensing area is wider than said transmission area. 

15 

16. The computer-readable medium of claim 13, wherein said 
transmitting object is said sensing object. 

17. The computer-readable medium of claim 13, wherein said 
20 program further comprises the step of: 

exchanging data between said sensing object and said one or more 
sensed objects based on said sensing area, and between said transmitting object 
and said one or more receiving objects based on said transmission area. 
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18. The computer-readable medium of claim 13, wherein said 
program further comprises the step of: 

determining whether said one or more sensed objects are within said 
sensing area, and whether said one or more receiving objects are within said 
5 transmission area. 

19. An information processing apparatus for management of 
information on objects placed in a 3-dimensional virtual space, said 
information processing apparatus comprising: 

10 a storage element configured to store information related to a sensing 

object, information related to one or more sensed objects, information related 
to a sensing area, information related to a transmitting object, information 
related to one or more receiving objects, and information related to a 
transmission area, wherein said sensing area is used for said sensing object to 

15 sense said information related to said one or more sensed objects within said 
sensing area, and wherein said transmission area is used for said transmitting 
object to transmit said information related to said transmitting object to said 
one or more receiving objects within said transmission area; and 

a processor, coupled to said storage element, said processor configured 

20 to selectively set said sensing area and said transmission area. 

20. The information processing apparatus of claim 19, wherein said 
transmission area is wider than said sensing area. 
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21. The information processing apparatus of claim 19, wherein said 
sensing area is wider than said transmission area. 

22. The information processing apparatus of claim 19, wherein said 
5 transmitting object is said sensing object. 

23. The information processing apparatus of claim 19, wherein: 
said processor is further configured to exchange data between said 

sensing object and said one or more sensed objects based on said sensing area, 
10 and between said transmitting object and said one or more receiving objects 
based on said transmission area. 

24. The information processing apparatus of claim 19, wherein: 
said processor is further configured to determine whether said one or 

more sensed objects are within said sensing area, and to determine whether said 
one or more receiving objects are within said transmission area. 
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ABSTRACT OF THE DISCLOSURE 



According to the present invention, there are provided an information 
processing apparatus, an information processing method and a 

5 computer-readable medium for use with a virtual reality environment. The 
information processing apparatus includes a sensing-area setting means for 
setting an area used to sense information on objects, and a transmission-area 
setting means for setting an area used for transmitting information on an object. 
The transmission area may be set wider than the sensing area. Thus, according 

10 to the present invention, information on an object can be reported to another 
object located at a remote position with a higher degree of reliability . 
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IS THE TRANSMISSION-AURA 
AREA OF THE AVATAR 82 VALID ? 



N 
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IS THE SHARED OBJECT MANAGEMENT 
TABLE SHOW THAT THE OBJECT X IS 
NOT AWARE OF THE AVATAR 82 AND 
HAS THE OBJECT X GOTTEN INCLUDED 
IN THE TRANSMISSION- AURA AREA 
k OF THE AVATAR 82 ? 



DOES THE SHARED OBJECT MANAGEMENT 
TABLE SHOW THAT THE OBJECT X IS 
NOT AWARE OF THE AVATAR 82 AND 
HAS THE AVATAR 82 ENTERED THE 
k RECEPTION-AURA AREA OF THE OBJECT X ?, 




UPDATE THE SHARED OBJECT 
MANAGEMENT TABLE BY ADDING THE 
AVATAR 82 TO THE SET B OF THE 
OBJECT X AND ADDING THE OBJECT X 
TO THE SET A OF THE AVATAR 82 
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BY EXPRESS MAIL NO. EL254067301US 



SONY-Q9095 



DGCiaration ana rower ot AiiornBy ror raiem Application 


Japanese Language Declaration 




As a below named inventor, I hereby declare that: 




My residence, post office address and citizenship are as 
stated next to my name. 


t (tk©*******©*^) flr t-cv**-*-. 


I believe I am the original, first and sole inventor (if only one 
named is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is 
claimed and for which a patent is sought on the invention 
entitled. 

INFORMATION PROCESSING APPARATUS, METHOD AND 
COMPUTER PROGRAM FOR VIRTUAL REALITY AURA 
Sbi IING 








the specification of which is attached hereto unless the 
following box is checked: 

J [ was filed on as United States Application 

Number or PCT International Application Number 
and was amended on (if applicable). 


Srt £ L -C V 3 £ 4 4: C £ fc* 9! L- * i\ 


I hereby state that I have reviewed and understand the 
contents of the above identified specification, including the 
claims, as amended by any amendment referred to above. 




I acknowledge the duty to disclose information which is 
material to patentability as defined in Title 37, Code of 
Federal Regulations, Section 1.56. 


*B&ASI3 SSI 1 9*(a)-(d)5Xli3 6 5* 
(b) 5Cte3t*TlE<0. Jit H&*<&H©'J>fe < i t- * Bfclfc 
5£LTV*.S4$lftt;*J**J 3 6 5 (a)5KJ£-f <SIStti». 3t 

IX rfl »- ' — — tw.d£3fc J © € C o f^- » TjCTuim v. v»0 v 


I hereby claim foreign priority under Title 35, United States 
Code, Section 1 19(a)-(d) or 365(b) of any foreign 
application(s) for patent or inventor's certificate, or 365(a) of 
any PCT International application which designated at least 
one country other than the United States, listed below and 
nave aiso lueniiTfeu Deiow, vy uiieuMny me uua, any luioiyu 
application for patent or inventor's certificate, or PCT 
International application having a filing date before that of the 
application on which priority is claimed. 


Prior Foreign Application(s) 

P1 0-277064 Japan 
(Number) (Country) 


Priority Not Claimed 

30 September 1998 

(Day/Month/Year Filed) 
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Japanese Language Declaration 



(Number) 



(Country) 
(S£) 



(Day/Month/Year Filed) 



I hereby claim the benefit under Title 35, United States Code, 
Section 119(e) of any United States provisional application(s) 
listed below. 



(Application No.) 



(Filing Date) 



(Application No.) 



(Filing Date) 



ftH. TE©*SS«*3 5812 04klz£^XT1Z<n* 
l^ft3 6 5 *(c)fc*r<*|*«*C£K±BL*1\ * 

lit. *mmn*n*MWtoPi9immii***a smi i 2* 



■(Application No.) 



(Application No.) 



(Filing Date) 

(tHJHB) 



I hereby claim the benefit under Title 35, United States Code, 
Section 120 of any United States application(s), or 365(c) of 
any PCT International application designating the United 
States, listed below and, insofar as the subject matter of 
each of the claims of this application is not disclosed in the 
prior United States or PCT International application in the 
manner provided by the first paragraph of Title 35, United 
States Code, Section 112 J acknowledge the duty to disclose 
information which is material to patentability as defined in 
Title 37, Code of Federal Regulations, Section 1 .56 which 
became available between the filing date of the prior 
application and the national or PCT International filing date of 
application. 



(Status: Patented, Pending, Abandoned) 



(Filing Date) 

(ffiBB) 



(Status: Patented, Pending, Abandoned) 
<5i« MMFW* AW*. 



I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on 
information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful 
false statements and the like so made are punishable by fine 
or imprisonment, or both, under Section 1001 of Title 18 of 
the United States Code and that such willful false statements 
may be jeopardize the validity of the application or any patent 
issued thereon. 
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Japanese Langi 


jage Declaration 




POWER OF ATTORNEY: As a named inventor, I hereby 
appoint the following attorney(s) and/or agent(s) to prosecute 
this application and transact ail business in the Patent and 
Trademark office connected therewith (list name and 
registration number) 


Karl A. Limbach 18,689 
George C. Limbach 19,305 
John K. Uilkema 20,282 
Neil A. Smith 25,441 
Veronica C Devitt 29,375 
Ronaid L Yin 27,607 
Gerald T. Sekimura 30,103 
Michael A. Stallman 29,444 
Philip A. Girard 28,848 
Michael J. Pollock 29,098 
Stephen M Everett 30,050 


Alfred A. Equitz 30,922 
Mark A. Dalla Valle 34,147 
Charles P Sammut 28,901 
Mark C. Pickering 36,239 
Patricia Coleman James 37,155 
Kathleen A. Frost 37,326 
Alan S Hodes 38,185 
Alan A. Lmbach 39,749 
Douglas C. Limbach 35,249 
Seong-Kun Oh* 

Cameron A. King 41,897 


Kyla L. Harriel 41,816 
Mayumi Maeda 40,075 
Kent J. Tobin 39,496 
Michael R Ward 38,651 
Roger S. Sampson 44,314 
Tina Chen P-44,606 
Charles L. Hamilton 42,624 
Andrew V. Smith 43,132 
Heath W. Hoglund 41,076 
J. Thomas McCarthy 22,420 
* Recognition under 37 CFR 10.9(b) 




S&nd Oorr^^nnnripnpp frv 

Charles P. Sammut, Esq. 
Limbach & Limbach L.L.P. 
2001 Ferry Building 
San Francisco, CA 94111-4262 




Direct Telephone Calls to: (name and telephone 
number) 

Charles P. Sammut 
(415) 433-4150 




Full name of sole or first inventor: 
SATORU MATS U DA 




Inventor's signature Date 




Residence 

Kanagawa, Japan 


mm 


Citizenship 
Japan 




Post Office Address 

c/o SONY CORPORATION 
7-35, Kitashinagawa 6-chome 
Shinagawa-ku, Tokyo, 141-0001 JAPAN 
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